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INTRODUCTION 


In Ontario the failure rate among immigrant tradesmen 
on the Certificate of Qualification Exams (hereafter referred 
to as C. of Q. Exams) set by the Ontario Department of Labour 
has been very high, but little is known about the relative im- 
portance of a number of possible factors underlying their poor 
performance. Does the high failure rate reflect inadequate 
knowledge of the trades according to Ontario's standards or lack 
of knowledge of English? On the assumption that the latter was 
of prime importance the practice of permitting an immigrant 
tradesman to write his C. of Q. exam with the help of an inter- 
preter has been adopted. However, this has not proved to be an 
effective solution because when a candidate passed the exam, it 
was difficult to know whether success was attributable to his own 


knowledge of the trade or the interpreter's trade knowledge. 


In this report an assessment of the results of a pi- 
lot project set up to seek answers to some of the above questions 
is presented. In this project, a group of immigrant trades- 
men were given a special English language course prior to 
writing their C. of Q. exams, and then wrote these exams in 


English without the aid of an interpreter : . Through this 


The pilot project was sponsored by the Citizenship Branch, 
Department of the Provincial Secretary and Citizenship, the 
International Institute of Metropolitan Toronto, the Canada 
Department of Manpower and Immigration and the Ontario 
Department of Labour. 
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process, it was hoped that the relative importance of the follow- 
ing casual factors could be unravelled: 
1) inadequate knowledge of the trade according 
to Ontario sastandards: 
2) lack of knowledge of the English language; 


3) inadequate knowledge of trade terminology. 


The analysis presented in this report attempts to determine the 
relative importance of these factors by examining the relation- 
ships between a number of variables and the failure and pass 
rates and average marks obtained on the C. of Q. exams after 


the English language course was completed. 


In the first section of the report the pilot project 
itself is briefly described, and this is followed by a statement 
of the main findings suggested by the analysis. A description 
of the demographic characteristics of the immigrant tradesmen 
involved in the pilot project is presented in the third part of 
the paper while the general performance on the C. of Q. Exam of 
these tradesmen are related to several possible explanatory va- 
riables in the fourth section. In the next section of the report 
the relationship between success on the C. of Q. Exam and pro- 


ficiency in English is examined, and a limited attempt is made 
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to isolate the importance of the latter factor relative to 
level of schooling and training with respect to performance 
on the C. of Q. Exam. In the concluding section of the 
paper, for those trade groups where the number of observa- 
tions will permit it, performance on the C. of Q, Exam is 
broken down by exam section for a more detailed investigation 
of areas of weakness to disentangle the language and trade 


knowledge problems. 


Brief Description of the Pilot Project 


The project, which commenced on July 22, 1968, was 
set up on a two-stage basis. Training in basic English con- 
stituted the first phase of the course. Classes were conducted 
four nights per week for twelve weeks (a total of 120 hours of 
instruction). This was followed by the trade terminology part 
of the course (a total of 80 hours of instruction) which was 
deisgned to familiarize the student with Canadian trade tems, 
uses and practices. Upon completion of the second part of the 
course, the trainees wrote their C. of Q. Exam in English with- 


out the assistance of an interpreter. 


To qualify for the program the candidate had to 


be an immigrant tradesman who had been granted a Provisional 


ef 


tsi sdt fo omeetiogmi.ofy, of 


Certificate of Qualifications by the Ontario Department of 
Labour. Candidates who had tried and failed the qualifying 
examination, at least once, were given priority in recruit- 


ment. 


Betore moving on to the statement of the main 

findings and the subsequent analytical sections it should 

be stressed here that the size of the sample and its com- 
position impose a serious constraint on the type of analysis 
which can be done. In many cases, the number of observations 
is simply too small for results to be meaningful and reliable. 
With respect to the data there are a number of gaps that 
created problems (missing files, incomplete information in 
files, and no data recorded). As a result, when candidates 
are grouped according to various criteria the totals are not 
always identical. However, because there does not appear to 
be any distinctive pattern to the missing information, it is 


rather unlikely that the incomplete data has created any bias. 
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SUMMARY OF CONCLUSIONS 


Although there are serious restrictions on drawing 
definite conclusions from the analysis because of the limited 
number of observations and gaps in the information on trainees, 
a number of patterns do emerge that are highly suggestive. 
While knowledge of English is undoubtedly a problem for 
immigrant tradesmen, this variable may have been given too 
much emphasis in recent years as being a key factor under- 
lying their poor performance on the C. of Q. Exam. The 
argument that a good knowledge of English would considerably 
reduce the failure rate on the C. of Q. Exam is based on the 
assumption that the candidate already has an adequate know- 
ledge of the trade. However, the fact that three-quarters 
of the immigrant tradesmen failed the C. of Q. Exam after 
taking a special English language training programme suggests 


that the latter assumption should be seriously questioned. 


Further, there are several indications that in- 
adequate trade knowledge may be an equally important factor, 
relative to knowledge of English, with respect to poor per- 
formance on the C. of Q. Exam. For example, if knowledge of 


English was the fundamental problem one would expect marked 


eee i 


ye er mo. sookxaintaien tardkaes ote oro > guoatA 


‘D 


oat 
bortmit: ‘te ei neungid teeta i nor? eit teutones, 9% Fo 


a ee 
aeitet aber fat ‘ed somaetet ont Er arma brs BatOd SWI: sede to’ ts 


i: 


ove vega ‘lity exe. ede Syyyanes ob aerating to ‘sina 


102: ste eae, 8 etbosel ob ak deiLyed to ogbefword otia 
me 1 

iad Aoi noait ovat wet oldainay eit ememesbers Seu a uth 
; \ nN via On) y) f e 
fF Jedi ogous “od! 5 Bio 2p, etsey yr979% nt eile ects: if mt 


os 
t i aii i ~ py j 1 ‘ r or * ‘ age Bl 
mest) OMe Kee Oo) Da ul) aed rey sonmuinrotrod SOM: tiedt g 
ee Fan ara Pehes iabue a arian to sgbelwoml Hong & Isis tase 
hoe. ‘ Re i een 2) meee 0 t6°.5 edd no ater atuligt i 
The ae. 4 ee ee | ee ae 


WHR GI Rpee ge Bel WWEITLS SISSLOGKS aris tid nots Dears 


u ' a eep- omens Il? Joat oft . eeyvou ieee off? to 9 9 
yi. . & i 
eo aa pois ry opt F : ap 4 
eee eee A.) elt hel ied Sry Seyi ofa 8 
, i A é i a 
‘ at dit Bi he Amer PRs Marre art PRIA i Long ta seg 5, pei 
* ss : 
‘ 


i) An , dite E reenyp “Misieitss, ad ty kino TOL Tees wattes alt. ' 
: : =o : { ; a? 


3 “4 im esta a j Ws ul jn P Le. 
ad EC Sent ermtigolting Leveveie sre, etorlt redo ne 


7 « Tota: Pasi YE Eewis an, ex VR Sabo {wend ober 


‘ot. 


ie aoe NO POOH OT Josqeert ait iw faiPend to opha Kuga: . 
vy : } ’ ; ; Y vi ; aa 
Rt | 20 gubsiwoml ii . 44 Wks TO Uae. +) TO... Dias Rg 


Gael rom TRGqKS ‘lew sir moaldory lasoomehak. od - 
i \ Fi aT 


improvement on the C. of Q. Exam as proficiency in English 
increased; but the analysis did not lend very strong support 
to this contention. Candidates with a mark under fifty per 
cent on the English language exam obtained an average mark 

of 43 per cent on the C. of Q. Exam, while those with a mark 
between 50 and 74 per cent in English achieved an average mark 
of 45 per cent on the C. of Q. Exam, an extremely small im- 
provement of two percentage points. On average, only those 
with a mark of 75 per cent or more on the English exam passed 
the C. of Q. Exam (the average mark for this group was 62 per 
cent). These results, especially the last one, were extremely 
suspicious and raised the question: Is the basic relationship 
between a candidate's "level of schooling and technical train- 
ing'' and success on the C. of Q. Exam with standing in English 
acting only as a proxy for this more fundamental factor? 
Additional probing lent some support to this contention but 
further research would be required before any definite state- 


ment could be made. 


The analysis of performance on specific sections of 
the C. of Q. Exam indicates that, in general, the knowledge of 
all aspects of the trade among the candidates was quite poor 


in terms of Ontario's standards. Serious gaps in knowledge of 
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trade theory and practice revealed by this part of the analysis 
suggests that language training can solve only part of the 
problem, and would be a complete solution to the problem only 
for those candidates who, from the point of view of Ontario's 
standards, are fully qualified and lack the knowledge of 


English only. 


As well, the analysis reveals that a candidate's 
working experience is not a good criteria for identifying 
his qualifications. However, to a large extent this can be 
explained by the fact that in current practice the documents 
offered as proof of experience are taken at their face value 
because the task of evaluating them would be formidable. 
Actually it appears that the first C. of Q. Exam acts as the 
effective screening device, whereby a candidate's qualifica- 


tions can be assessed. 


While it appears that a special English language 
course is not a panacea, it is recommended that such a course 
does have a legitimate role to play in that it would permit 
the C. of Q. Exam to be used as an adequate filter. If an 
immigrant tradesman was permitted to write the C. of Q. Exam 


without an interpreter only after taking a special English 
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language training course (or after demonstrating a minimum 
pre-determined proficiency in English) it would then be 
possible to analyze performance on the C. of Q. Exam to 
objectively assess whether the candidate's qualifications 
meet Ontario Standards. If the candidate fails, it would be 
possible to pinpoint areas of weakness by examining specific 
sections of the C. of Q. Exam and counsel the candidate with 
respect to the type of skill upgrading he requires before 
taking the C. of Q. Exam a second time. Such a procedure 
would relieve the Industrial Training Branch of making all 
kinds of subjective decisions based on documents that cannot 
be realistically validated and place the onus of proof where 


it belongs, on the candidate. 
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BRIEF SUMMARY OF THE 
CHARACTERISTICS OF THE TRAINEES 


For brevity no detailed data are presented in this 
section. These are included in an Appendix at the end of the 
report and, for the reader's convenience, the relevant table 
in the Appendix that contains the data for each characteristic 


dealt with in this summary is noted. 


A total of 205 immigrant tradesmen registered for 
the special English language training course. Electricians, 
comprising 47.3 per cent of all trainees, constituted the 
largest trade group in the project (see Table A). Next in 
size were Motor Vehicle Repairmen (M.V.R.) with 55 candi- 
dates (26.9 per cent of all trainees). Plumbers, Steamfitters 
and Sheet Metal workers were represented respectively by 30, 


16 and 7 candidates. 


Out of the total number of 205 candidates in the 


project, 133 trainees wrote their C. of Q. Examination which 


Because of the suspicion of subjective evaluation of some 
exam results, a group of 10 electricians was excluded 
from the analysis. Also, a group of hairdressers, accord- 
ing to the registration list, numbering 10 persons, are 
not examined here. The data on this group were extremely 
poor. 
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_ gave an overall completion rate for the project of 64.9 per 
cent. Seventy-two candidates (35.1 per cent of the total) 


were Classified as drop-outs”. 


Candidates in the project came from 25 different 
countries (see Table B), The largest ethnic groups were 
Italians with a total number of 76 trainees (37 per cent of 


all trainees) and Greeks with 43 candidates (21 per cent). 


The average age for all trainees was 29.7 years 
and varied from 28.6 years for motor vehicle repairmen to 
32.4 years for steamfitters. Also, the average age for 
different ethnic groups did not differ significantly from 
that for the trade groups (see Table C). While the age of 
individual candidates ranged from 20 to 58 years of age, the 


majority, over 60 per cent, were 20 to 29 years of age. 


5. The term 'drop-outs' has a specific meaning here. It 
refers to all candidates who have not taken the C. of Q. 
Exam; but it does not necessarily mean that they have 
not completed the English language training programme. 

A number of candidates attended classes quite regularly 
but did not appear for the final exam. At the same time, 
since the attitude towards attendance was very liberal, 
there were candidates with very poor attendance records 
and drop-outs from the course who took the exam. To make 
allowances for all these cases would mean establishing 
several groups of drop-outs. This kind of detailed 
breakdown would suffer because of the resulting small 
numbers of candidates in each category. 
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Ninety candidates, 43.9 per cent of the total, 
listed for the project were married (see Table D). Single 
candidates comprised 34.6 per cent of the total4, Unfor- 
tunately, a data were available on the married status of 


44 candidates (21.5 per cent of the total number of trainees), 


Among candidates with dependents (91 persons and 
44.3 per cent of the total), the largest group had one de- 
pendent (31 persons). Twenty-five candidates had 2 depend- 
ents (27 per cent of the group) and only 14 candidates had 


more than 4 dependents (see Table E). 


While the regulations in Ontario state that a 
minimum level of education of Grade 10 is required before a 
candidate can enter an apprenticeship programme, only 40 
candidates had completed Grade 10 (about 20 per cent of the 
total). There were 95 candidates (47 per cent of the total) 
with Grade 8 or less. The majority of candidates had records 
of taking apprenticeship or some type of technical training 


in addition to their academic schooling (see Table F). 


py eche category 'single' also includes divorced and separated 
persons without dependents. 


ao Oe 


The candidates’ length of residence in Canada ranged 
from a few weeks to several years. However, it is interesting 
to note that the majority of them were newcomers. Seventy-five 
per cent of all candidates in the project had been in Canada for 
four years or less, while 71 (34.6 per cent of all trainees) had 


been in the country for less than twelve months. 
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OVERALL PERFORMANCE ON POST-TRAINING 
C. OF Q,. EXAMINATION 


AND RELATIONSHIP TO SELECTED VARIABLES 


Performance on the C. of Q. Exam by Trade Groups 


While the overall failure rate on the C. of Q. Exam 
was 75.2 per cent, there was considerable variation between 
trade groups. For example, the failure rate ranged between a 
low of 33.3 per cent for sheet metal workers (only 6 candidates) 
to a high of 95.2 per cent for plumbers (see Table 1). However, 
considering the absolute number of candidates in each group, 
electricians with a failure rate of 65.6 per cent had the best 


performance on the C. of Q. Exam. 


The average marks obtained on the C. of Q. Exam by 
trade group are also shown in Table 1. These generally rein- 
force the impressions obtained from the failure rates. On 
average, every group was below the 60 per cent required to pass 
the exam. Sheet Metal workers with 57 per cent were quite 
close to the pass mark. Electricians and steamfitters were 
next with unimpressive averages of 51.0 and 50.8 per cent res- 
pectively, while plumbers obtained an average mark of 40 per 
cent and M.V.R. were at the bottom of the scale with an average 


mark of 33 per cent. 
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Also, a breakdown of candidates into Passed and Failed 
groups reveals essentially the same pattern. All the candidates 
in the 'Passed' group had an average only slightly above the 60 
per cent pass mark on the C. of Q. exam, and the average marks 


for candidates who failed the exam were extremely poor. 
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Comparison of the Candidates’ Performance on the C. of Q. 
Examination Written Prior to Language Training with their 


Performance on this Exam After Language Training 

For 54 trainees, 42.5 per cent of the total, it was 
possible to undertake a comparison of the C. of Q. Exam results 
before and after language training was taken, All the candi- 
dates in this group had written the C. of Q. Exam at least once 
before training and failed, and 22 of these 54 candidates had 
written the exam a second time and failed again. In general, 
the results on the exams taken prior to the special English 
course were poor with average marks far below the pass mark of 
60 per cent (see Table 2). On the first pre-training exam, an 
average mark of 34.2 per cent was obtained. For the 22 can- 
didates who wrote the exam a second time, a slightly better 


average mark of 38 per cent was achieved. 


For these 54 candidates taken together, an average 
mark of 48.5 per cent was obtained on the C. of Q. Exam written 
after they had taken the English language course and their 


failure rate was 74 per cent. These results are extremely poor 


The records on previous exam history of candidates are 
quite poor and, thus, there is quite a strong possibility 
that this figure does not include all candidates who tried 
the C. of Q. Exam prior to their language training. 
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and suggest that, in general, inadequate trade knowledge may 
be the fundamental stumbling block that immigrant tradesmen 


must overcome. 


An analysis by trade group of those candidates who 
tried the C. of QO. Exam at least once before taking the 
English language course also suggests that the latter is not 
a panacea. For example, Electricians obtained an average 
mark of 52.1 per cent on the C. of Q. Exam taken after English 
language training. This represented an improvement of 12.3 
per cent over the average mark of 39.8 per cent achieved on 
the C. of Q. Exam written before taking a special English 
language course (see Table 2). M.V.R. obtained an average 
mark of 28.4 per cent on their first C. of Q. Exam and the 
average increased to 41.8 per cent on the post-English 
language training C. of Q. Exam; but an additional 18.2 per 
cent is required in order to barely make the grade. The 
other trade groups cannot be analyzed because of the small 


number of candidates involved (7 trainees and 3 trade groups)®, 


6. While additional detailed analysis on this aspect is not 
possible, it is interesting to note that those electricians 
who passed the post-training exam had an average of 66.6 
per cent as compared with 44.6 per cent at the first writ- 
ing. Electricians who failed the post-training exam im- 
proved their average mark only by 7.2 per cent as compared 
with the results of the first exam (37.2 per cent and 
44.4 per cent respectively). This seems to indicate that 
for many immigrant tradesmen the knowledge of the trade is 
poor from the point of view of Canadain standards. 
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Influence of Foreign Work Experienced on 


Performance on C. of Q. Exam 


In Table 3 average marks and failure rates on the 
post-English language training C. of Q. Exam are shown for 
116 candidates where information on number of years of foreign 
work experience was available. Because of the limitations 
imposed by the records and the limited number of observations 
it was necessary to use two broad categories. The categories 
employed are ''four years or less of foreign work experience" 
and ''over four years of foreign work experience''. Admittedly, 
this analysis is very crude, but it does provide some indi- 
cation that a candidate's statement on his work experience in 


country of origin is of little value as a guide. 


Overall, for the 116 candidates in question the 
failure rate on the C. of Q. Exam was 78.4 per cent. The 
failure rate for those with more than 4 years of foreign work 
experience was slightly lower, 74.6 per cent, while the fail- 
ure rate for candidates with 4 years or less of foreign work 
experience was slightly higher than the average 83.0 per cent, 
Similarly, there was little difference between these two 
groups when average marks on the C. of Q. Exam were compared. 
These results suggest that it would be very dangerous to use 
statements on previous work history in country of origin as 


a measure of trade knowledge for immigrant tradesmen. 
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TABLE 3 


“Performanceton the C. of'Q. Exam ’After Special 
English Language Training by Years of 
Foreign Work Experience 


Years of Foreign No. of No. of Failure Av. mark on 
Work Experience Candidates Failures Rate C208.) esa 
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Effect of Schooling on Performance 

To determine whether schooling and additional 
technical training affects performance on the exam, the 
trainees were grouped by level of schooling and average 
marks, Failure rates on the C. of Q. Exam were com- 
puted for each group (see Table 4). In general, the data 
reveals a positive relationship between the level of 
Dorie and average exam mark. Candidates with Grade 7 
or less obtained an average mark of 43 per cent; those 
with Grade 9 achieved an average mark of 48 per cent; and 
the average mark for candidates with Grade 10 was 52 per 
cent. Conversely, the failure rate decreases as the level 
of schooling rises. It should be noted that, in spite of 
the fact that the whole pattern is quite consistent and 
better results are associated with a higher level of edu- 
cation in every case, the average mark in each group is 


still far from meeting the minimum Ontario standard. 


The last two rows (5 and 6) in Table 4 group the 
candidates for whom there is a record of taking apprentice- 
ship or some type of technical training at any time in addi- 
tion to their academic schooling. Again, candidates with 


more technical training achieve slightly better results, but, 


{ by 


OL is A a a j ‘ 

‘ Pe ares Sa \ 7 * rs, * 
egy ip om bey gy e ae Pod rd ad 
LUGS HO get i oord3e 

eerie icere a ein emaeeestiente he Leeeeeetinmin tea 
' mi 
' . ‘ P 

wae Pe, Peake ee les en te eee ; “ey 
a me G said . a a Paw SMe? . wheal bh td ied + 


} As 4 BWA . UL LAQOR 


43 
: 
i 
rt 
ae 


4 i 
J * _* bat i * * 
apliesi jolled vfiigkie overipa aetitert 
» as ‘¥ 


rly 


mr 22. x 


in this case, the difference is not large enough to permit 


any meaningful conclusion to be drawn. 


This overall analysis of average marks and failure 
rates on the C. of Q. Exam for candidates who had taken the 
special English language training programme is not very 
encouraging. Also, the positive relationship between average 
mark a the C. of Q. Exam and such variables as years of ex- 
perience and level of schooling lead one to speculate that 
the fundamental problem may be an inadequate knowledge of the 
trade rather than an inability to write the exam because of 
an inadequate knowledge of basic English or trade terminology. 
In the next two parts of the paper, an attempt is made to 


unravel this problem. 
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Grade Attained | 


Grade 7 or less 

Grade 8 

Grade 9 

Grade 10 or more 

Academic Schooling 
plus technical 
training 

3 years or less 


4 years or more 
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TABLE 4 


Results on C. of Q. Exam 
By Level of Schooling Attained 


(a) (b) (c) 
Number of 
Total Number Average of Candidates 


of Candidates Exam Marks who Failed 


26 43 a5 
29 od 22 
19 48 1Z 
26 32 16 
47 46.0 0 
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INFLUENCE OF THE SPECIAL ENGLISH LANGUAGE 
TRAINING PROGRAM ON PERFORMANCE ON 


THE C. OF Q. EXAM 


In this section of the paper an analysis of the 
C. of Q. Exam results with respect to a candidate's know- 
ledge of English is undertaken to provide some assessment 
of whether the solution to high failure rates among immi- 
grant tradesmen is to provide an opportunity for them to 
up-grade their English and learn trade terminology or whether 
the key problem is inadequate trade knowledge and, therefore, 
skill up-grading is the answer. Unfortunately, because of 
several information gaps definitive conclusions and strong 
guide posts for future policy cannot be drawn from the analy- 
sis. To be more specific, the type of analysis undertaken 
in this section has been conditioned by the following 


restraints: 


a) According to the original procedure set 
down for the pilot project, in order to 
be eligible for the trade terminology part 
of the course a candidate had to achieve 


a unit 10 standing in the initial basic 
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English part of the course’. However, in 
practice this rule never came into effect 
and all candidates, regardless of their 
standing in basic English, were allowed to 


continue the program, 


b) No formal evaluation of the students' per- 
formance on the second phase of the course 
(trade terminology) was made. The only 
source of information on this aspect is the 
teachers’ brief comments describing the can- 
didates as excellent, good, fair or poor. 
Also, this classification is available only 


for, 77+ candidates. 


The first point noted above has made it difficult to do a truly 
meaningful analysis in this section, and because of the second 
problem, (b), it was not possible to make any vigorous analysis 
of the C. of Q. Exam results with respect to a candidate's 


knowledge of English trade terminology. In an attempt to 


7. The International Institute of Metropolitan Toronto employs 
the "unit'’ instead of the ''grade'' system. The unit scale 
ranges from 1 to 20. 
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circumvent the latter it was necessary to compare a candidate's 
mark on the C. of Q. Exam with whether the instructor thought 
his knowledge of trade terminology was excellent, good, fair 


or poor. 


Performance on the First Phase of the Course 


(Basic English) Related to C. of Q. Exam Results 


Data on performance on the C. of Q. Exam in relation 
to a candidate's standing in the first phase of the course 
(basic English) is presented in Table 5. The candidates were 


grouped into three categories: 


a) better than average candidates with a mark 
in English cf Jooper cents orn more 


b) average candidates with a mark in English 
between 50 and 74 per cent 


c) below average candidates with a mark in 
English under 50 per cent. 


Assuming that inadequate knowledge of English was the key pro- 
blem, then, one would expect a definite improvement in a can- 
didate's performance on the C. of Q. Exam as his proficiency 
in English increased; but the data lend little support to this 
hypothesis. Overall, candidates with a mark under 50 per cent 


in English achieved a mark of 43 per cent on the C. of Q. Exam. 
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As one moves to those who obtained between 50 and 74 per cent 
in English the average mark on the C. of Q. Exam rises only 
by two points to 45 per cent. Not until the category''75 per 
cent or more in English''is reached is there any substantial 
evidence of marked improvement. For this group the average 
mark on the C. of Q. Exam was 62 per cent. Also, for two 
trade groups that could be examined separately - Electricians 


and M.V.R. - the same pattern held. 


On the other hand, the failure rate does fall as 
proficiency in English increases; but, again, the results are 
not too encouraging. For example, even for those candidates 
with 75 per cent or more on the basic English exam, 50 per 


cent failed. 


To investigate the problem in more detail the 
candidates'C. of Q. Exam results were cross-classified by 
mark obtained in the basic English part of the course and 
level of education. However, because of the limited number 
of observations this was attempted using only two categories 
of marks in basic English. These were "less than 50 per cent"! 
and ''SO - 74 per cent'' (see Table 6). At any given level of 


proficiency in English there is a tendency for average mark 
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TABLE 6 


Performance on C. of Q. Exam By 
Level of Schooling and Marks 
in Basic English 


Marks in Basic English 


Grade Attained Less than 50% 50 - 74% 
No. of Average Mark No. of Average Mark 
Candidates C.-of Q. Exam Candidates C. of Q. Exam 
Grade 7 or less 14 42.0 10 43.1 
Grade 8 14 40.2 id 47.4 
Grade 9 8 Bout 6 48 .3 


Grade 10 or more 9 ASS 6 55.0 


ERAS pe 


obtained on the C. of Q. Exam to rise as level of education 


increases. 


These statistics are highly suggestive and raise 
the possibility that performance on the C. of Q. Exam may be 
more Closely related to a candidate's level of education 
than to proficiency in English. However, a more comprehen- 
Sive evaluation would be required to precisely determine the 


relative importance of these factors. 


In Table 7 performance on the final C. of Q. Exam 
is related to the candidates' rating on the trade terminology 
part of the English language course. The average marks on 
the C. of Q. Exam were very low for those with a "poor" or 
"fair" rating in trade terminology and, conversely, the fail- 
ure rates were very high: 95.6 and 100.0 per cent. Even for 
those candidates who received a "'good'' rating in trade termi- 
nology, the results were disappointing. The average mark on 
the C. of Q. Exam for this group was 53.3 per cent and over 
one-half of them failed. Only among those candidates who 
were judged to have an ''excellent knowledge'of trade termino- 
logy were the results favourable. These candidates obtained 
an average mark of 65 per cent on the C. of Q. Exam and only 
one-quarter failed. Again, these results cause one to 


speculate that trade knowledge may be an important problem. 
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TABLE 7 
Knowledge of English Trade Terminology as 
a Predictor of Candidate's Success on 
the: C.. of G. Exam 


Performance on 


English Trade No. of Average Mark on No. of Failure 

Terminology Candidates C..0L, 0... Exain Failures Rate 
Course 

Excellent IZ 65.0 3 25.0 

Good 30 rie! 16 aie 

Fair 12 39.0 12 100.0 


Poor Fae S00 22 95.6 
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ANALYSIS OF C. OF Q. EXAM RESULTS 
BY EXAM SECTION 


As mentioned earlier, for several trade groups there 
were a large enough number of candidates to permit a review of 
results achieved on each section of the C. of Q. Exam. This 
approach offers a better opportunity of disentangling know- 
ledge of English and trade knowledge as factors underlying the 
high failure rate among immigrant tradesmen on the C. of Q. 


Exam. 


Electricians 

For Electricians the C. of Q. Exam questions were 
classified into three categories: code, theory and trade 
knowledge. Also, each category was marked separately with 100 
per cent being the highest possible mark for any one category. 
In Table 8 the average marks achieved in these three areas are 
cross-classified by the total final mark received on the C. of 


Q. Exam. 


For this analysis the section on code may be quite 
important. It groups together all the exam questions that can 
be answered by using the Ontario Hydro Code Book which candi- 


dates can refer to when writing the C. of Q. Exam. Thirty per 
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cent of all the exam questions can be answered by referring 
to this Code Book. As shown in Table 8, Electricians who 
passed the C. of Q. Exam did best on the Code Section of the 
Exam with an average mark of 72 per cent. However, these 
candidates also did well in Theory, 70 per cent and had 
their lowest mark, 60 per cent, on the trade knowledge sec- 
tion. Electricians who obtained an average mark in the 45 to 
less than 60 per cent range on the C. of Q. Exam had an 
average mark of 55 per cent on the Code Section, but the 
average mark fell to 43 and 48 per cent on Theory and Trade 
Knowledge respectively. Candidates with a final mark on the 
C. of Q. Exam below 45 per cent performed very poorly on 


every section of the exam. 


In general, the low marks obtained on the Trade 
Knowledge Section suggests that knowledge of the trade is poor. 
This refers to all candidates since even those who passed the 
C. of Q. Exam barely made the grade on this section. Also 
those candidates who failed the exam showed a serious lack of 


familiarity with Code Book specifications. 


In an attempt to shed more light on the problem a 


candidate's mark on the Code Section of the C. of Q. Exam was 
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TABLE 8 


Performance on the C. of Q. Exam By 
Exam Section for Electricians 


Average Mark by Exam Section 


Average Mark on eee 
C. of Q. Exam Code Theory Trade Knowledge 
60% or more 72 70 60 

45% less than 60% 55 43 48 

Less than 45% 35 31 39 


TOTAL ce 48 49 
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cross-classified by his mark on the basic English exam. 
The assumption underlying this procedure is that a can- 
didate's ability to use the Code Book is determined 

mainly by his knowledge of English. The data are pre- 


sented in Table 9. 


TABLE 9 


Performance in Basic English Related to 
Results on the Code Section of the 
C. of Q. Exam for Electricians 


Average Mark 


Mark in Basic English No. of Candidates on Code Section 
75% and over 9 ibs 
50 - 74% 16 47 
Less than 50% 2 5S 
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Overall, the results on the Code Section of the C. of 
Q. Exam were poor for candidates who had obtained less than 75 
per cent in basic English. Also, those with less than 50 per 
cent in basic English actually had a higher average mark on the 
Code Section than those with 50 to 74 per cent in basic English: 
53 per cent compared with 47 per cent. Only for those candida- 
tes with 75 per cent or more in basic English was the average 
mark on the Code Section acceptable. While no strong conclusions 
can be drawn from this analysis, the data lend some support to 
the suspicion that trade knowledge may be a more important 
problem than knowledge of English for immigrant tradesmen, es- 
pecially since those candidates who obtained between 50 and 74 
per cent in basic English were, on average, unable to effectively 


use the Code Book. 


Next, an attempt to determine the impact of an 
Electrician's level of schooling on his performance on the Theory 
Section of the C. of Q. Exam was undertaken (see Table 10). As 
one moves from candidates with Grade 7 or less to those with 
Grade 8, there is a definite increase in the average mark 
(41.7 to 48.5) and a marked drop in the failure rate from 92.8 
to 66.6.” There is little difference ati the nextilevel’ of edu- 


cation (Grade 9). In fact, the failure rate for those with 
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Grade 9 is higher than at the Grade 8 level. However, for 
candidates with grade 10 or more, again, there is a great im- 
provement. The average mark on theory rises to 52.0% and the 
failure rate on this section of the exam falls to 53.3%. 
Again, while not conclusive, these data suggest that education 
and training may be as important as knowledge of English with 
respect to an explanation of high failure rates among immi- 


grant tradesmen. 


TABLE 10 


Performance on Theory Section of the 
C. of Q. Exam and Level of 
Education for Electricians 


Grade Attained No. of Average Mark on Failure 
Candidates Theory Section Rate 
Grade 7 or less 14 Al] 92.8 
Grade 8 12 48.5 66.6 
Grade 9 ile 47.3 (ee) 
Grade 10 or more 1S 52.0 BS. 


1, The failure rate here is the percentage of candidates that 
failed that section alone. 


e308 


Motor Vehicle Repairmen 

A brief analysis of the performance of auto mechanics, 
the second most important trade group in the pilot project, by 
exam section may also be of some value. The C. of Q. Exam for 
this trade is divided into seven sections and each section is 


given a separate mark (see Table 11). 


TABLE 11 


Motor Vehicle Repair Examination 


Section Description Possible Score 
1 Engines 29 
2 Cooling Systems 13 
5 Fuel Systems 26 
4 Power Trains 16 
5 Brakes § Wheels b/ 
6 Power Steering & Frame 10 
Z Electrical 24 


TOTAL 155 
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In Table 12 results by exam section are presented 
for all candidates with a breakdown into "passed'' (60 per 
cent or more) and ''failed" (less than 60 per cent) categories. 
Section 6, Power Steering, was the most troublesome for all 
candidates. The overall average mark was only 31% and even 
candidates who passed the exam had an unimpressive average 
mark of 46%. However, this should not be too surprising 
since 5 out of 10 questions on this section are on power 
steering and apparently immigrant auto mechanics are not 
familiar with them. Section 7, Electrical, also presented 
problems; but it should be noted that this section is diffi- 
cult for all candidates including Canadian tradesmen and 60% 


on this section is considered as a good mark. 


Candidates who passed the exam found Section 4, 
Power Trains, the easiest (their average mark is 78%) Also, 
the average mark rose slightly in this section for all can- 
didates compared with the average marks on all other sections. 
Generally speaking, with the exception of 6 candidates who 


passed the exam, the results are very poor on every section. 


Plumbers 
Some detailed analysis of performance on the C. of 


Q. exam can also be presented for plumbers. Table 13 
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indicates the exam Sections with the possible score for each 
section. Also, the table shows the average marks received 
by candidates and indicates what percentage of each Section 
can be answered from the Code Book. By knowing how to use 
his Code Book, a candidate can obtain as much as 37% on the 


examination. 


The average marks were generally very low for 
every Section. This is not surprising since all but one of 
the candidates in the group failed the exam. Section 6 on 
Rural Water Supply Systems was the most difficult for all 
the candidates and the average mark for the group is only 
19%. It should be noted here that this Section might be 
troublesome for plumbers from urban areas who have never 


worked in rural areas. 


The highest average mark (47% which is still 
very low) was registered for Section 2. From the language 
point of view, this was an important Section since all 
questions except one could be answered by simply looking 
up the answer in the Code Book. On Section 4, where 62 
per cent of the questions could be answered using the Code 


Book the performance was also poor. The average mark for 
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this section was 45 per cent. 


While average marks were higher on those 
Sections containing the largest number of questions 
that could be answered using the Code Book, still, the 
performance was much below a minimum pass level. Again, 
these results raise the suspicion that trade knowledge 
according to Ontario Standards may be just as important 
a problem as knowledge of English. However, only 
through further research could this contention be ade- 


quately tested. 
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APPENDIX 


DEMOGRAPHIC CHARACTERISTICS OF CANDIDATES 
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TABLE C 


Candidates' Average Age by Trade Groups 


Average Age 
Passed § 
Failed 


Trade Group 


Candidates Drop-outs 


Electricians 29.6 29.9 
M.V.R. 28.6 PAL Eh 
Plumbers S07 
Steamfitters Zid 


Sheet Metal Workers 


TABLE D 


Marital Status of Candidates 


All Candidates 


Trade Group 


Electricians 


M.V.R. 550) 10020 
Plumbers 30 100.0 
Steamfitters Lon 2LOORO 


Sheet Metal 
Workers 


DK - no information available. 
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TABLE E 


Candidates By Number of Dependants 


All Candidates 


No. of Dependants 


Three 
Four 
Five or more 


D.K. 


TOTAL 


TABLE F 


Candidates By Level of Schooling 


Candidates taking 
C. of Q. Exam 


Last Grade Attained 


Grade 7 or less 
Grade 8 
Grade 9 


Grade 10 or more 


TOTAL 
Academic Schooling plus 
Some Type of Technical Training 
3 years or less ol 47.8 


4 years or more 
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